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ABSTRACT 

A search of experimental and theoretical literature 
and an analysis of professional textbooks, instructional materials, 
and published tests vrere carried out in order to (1) determine 
current concepts of reading comprehension deriving from experimental 
investigations, verbal statemaits, and models and (2) establish the 
extent to which these concepts were represented consistently in 
current secondary reading professional textbooks, instructional 
materials, and published tests* The study revealed a basic dichotomy 
between concepts of comprehension described in terms of overt 
behavior (particular skills) and those described in terms of covert 
behavior (cognitive operations) : much of the difficulty in 
understanding the nature of comprehension appears to derive from a 
failure among experimenters and theorists to associate overt behavior 
with underlying covert processes. It was concluded that until the 
covert psychological process which produces coniprehension is 
explained, verbal descriptions of comprehension skills (and, by 
implication, instructional objectives) are almost certainly going to 
be imprecise. (Various experimental definitions of comprehension are 
delineated and a bibliography is appended.) (MF) 
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The purpose of this study was twofold: (1) to determine current concepts of 
reading comprehension deriving from experimental investigations, verbal 
statanents, and models, and (2) to establish the extent to which these concepts 
were represented consistently in current secondary reading professional 
textbooks, instructional materials, and publish^! tests. 

Two major assumptions formed the basis of this investigation. Hie first 
was that the ultimate objective of the reading act is to understand what is read. 
This understanding is usually referred to as comprehension. However, though the 
Importance of comprehension is widely recognized by reading authorities, 
comprehension is one of the least understood aspects of the reading process. 
For this reason there was a need for a study such as the present one which 
would draw together and analyze the findings of the growing nvmiber of experimental 
and theoretical investigations of comprehension. Such a study would provide 
an inclusive description of the present knowledge relating to comprehension 
and of the prevailii^^ concepts by which comprehension is explained. Such a 
study would also indicate the direction further investigations of comprehension 
might take while providing a comprehensive framework within which these 
^ investigations could be carried out. 
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The second major assumption underlying this study was that the ultimate 
purpose of educational research is the inprovement of educational practice. 
The rapid development of reading instruction in the secondary grades over the 
past decale has resulted in a growing number of professional texthooks intended 
for secondary reading teachers, secondary reeding instructional materials, and 
published reading tests for the secondary grades. The second phase of the 
present study was to determine the extent to which current concepts of reading 
comprehension deriving ftom experimental investigations, verbal statements, and 
«,dels were represented in secondary reading professional textbooks, instructional 
^.terials, and published tests, and to detennine the degree of consistency in 

these representations* 

Specifically, the major questions which this study sought to answer were 

the following: 

1. What are the current concepts of reeding coniprahension which derive from 
experimental investigations, verbal statements, and models? 

2. Which current concepts of reading comprehension are represented in 
professional textbooks intended for secondary teachers? 

3. Which current concepts of leaiing comprehension are represented in 
i«,tructional materials intended for teaching reading in the secondary grades? 

4. Which current concepts of reading comprehension are represented in. 
published reading tes.s designed for the secondary grades? 

5. TO What extent does agra.msnt exist among the concepts of comprehension 
represented in secondary reading professional textbooks, instructional 
materials, end published tests? 
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Tho daflnitlons of terms used In this stud^ were the following: 

1. Experimental definition of comprehension is any definition stated by 
an author that is derived directly from the testing of a hypothesis by the 
collection and analysis of data» For example^ ar^ experimental definition would 
be provided by a factor analysis study undertaken to test the hypothesis that 
reading comprehension can be accounted for by a single factor* If this 
hypothesis was confirmed , an experimental definition of reading comprehension 
would be provided by the interpretation given to the single factor isolated. 

2. Verbal definition of conprahensicn is any definition stated by an author 
that is not directly supported by experimental evidence. For example, a verbal 
definition would be given by the statement that reading comprehension resiilts 
from the mental processing of language, provided that this statement was not 
directly supported by the findings of an experimental investigation* If the 
statement was directly sup?ortei by the findings of an experimental investigation, 
it would be an experimental definition* 

3» Professional textbook is a unified and comprehensive treatment of the 
major issues in reading instruction written for classroom teachers* 

4* Instructional material js are materials designed and developed to 
facilitate the teaching of reading in the secondary grades* 

5. Published rep.iing tests are reading tests designed and published to^ 
measure the general or specific reading: performance of students in a group 
situation* 

6* Secondary grades are considered to include grades ei^t throu^jh twelve* 
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KSTHOD 

Tba initial stage of this stiidy involved an intensive search of both 
the experimental and theoretical literature pertaining to reading comprehension* 
?he relevant experimental literature was identified through the ERIC/CRISR 
system* Pertinent theoretical literature was determined by a thorough search of 
lUblished bibliographies containing references to articles relating to 
eon^rehension* 

Professional textbooks i instructional materials , and published tests 
intended for seconiary reading were also identified* All current professional 
textbooks dealing in depth with comprehension and written for prospective and 
practicing secondary teachers were selected from a recent compilation of 
resources available to these teachers (Summers , Marker , and Trull , 1970)* The 
instructional naterials analyzed were those designed for the secondary grades 
contained in the extensive collection of instructional reading materials located 
in the University of British Coliunbla Reading Resources Centre* This collection 
has been developed over a number of years by faculty members in the Department 
of Reading Sducatlon to give prospective and practicing teachers a broad cross- 
section of available elementary and secondary instructional materials in 
reading* It therefore provided a representative source of currently available and 
used secondary' reading instructional taterlals* ?lnallyi published reading 
tests containing measxirea of comprehension applicabla to l^a secondary grades 
were determined from an examination of a recent comprehensive listing of 
published reading tests (F^rr, 1969)* 



FINDINGS 



(hirrent Concerts of Contprehenslon 

Experiinental definitions of cojiprehension ^ Sxparimental investigations of 
comprehension may be classified according to three main types: statistical 
analyses 9 studies of the specificity of comprehension, and instrospective- 
retrospective verbalization case studies • Statistical analyses of comprahansion 
have involved subjects drawn from the elementary grades throu^ collece and 
have utilized a broad range of tests • The analytic procedure most often employed 
has been factor analysis (Alsham, 1964; Anderson, 1949? Conant, 1942; Davis, 1944; 
Derrick, 1953; Feder, 1938; Hall and Robinson, 1945; Harris, 1948; Langsam, 1941; 
Mazurkiewicz, 1957; Richardson, 1950; Sutherland, 1966; Vernon, 1962), although 
item analysis (Hunt, 1957), simple correlation analysis (kcCuIIou^, 195*^)1 and 
multiple-regression procedures (Davis, 1968) have also been used* Some studies 
have isolated only one factor while othsrs have isolated a number, two of which 
are usually interpreted as word knowledge and reasoning* Studies of the 
specificity of comprehansio . have involved subjects and measuring instruments 
similar to those used in iriiat have bean termed statistical analyses (Artley, 1944; 
Cooper, 1955; Grim, I94O; Llaney, 1959; KcCallister, 1930; SicKalion, 1943; 
Robinson ard Hall, 1941; Shores, 1943; Shores and Saupe, 1953; Sochor, 1958; 
Swenson, 1942). Generally, while a definite degree of specificity with respect 
to the comprehension of reading materials in different content areas was apparent 
from these studies, some commonality was also shown. Introspective-retrospective 
verbalization case studies have suggested a number of mental oprratiorws 
accompanying comprehension (Jenkinson, 1957; Piekarz, 1956; Smith, 1967; Stemmler, 
1969; Strang and Rogers, 1965; Swain, 1953; Ward, 1968). 
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The various experimental definitions of reading comprehension may be 
summarized as follows; 

1.00 Comprehension as defined by statistical analyses 

1«10 Comprehension is a unita*, mental ability having no distinguishable 
subskills 

lt20 Conq?rehension is a composite of a numoer of subskills, the 
two most common being interpreted as word knowledge and 
reasoning 

2tOO Comprehension as defined by studies of its specificity 

2»10 Comprehension is to agreater or lesser extent specific to 
the content material being read 

3tOO Comprehension as defined by introspective-retrospactive verbalization 
case studies 

3tlO Comprehension is a cognitive activity involving the following 
mental processes 

3#11 Ideational Fluency: a large number of responses leading to 
the determination of meaning on an abstract rather than a 
literal level 

3tl2 Linguistic Fluencyi a general sensitivity to language and to 
the use of language clues in the determination of meaning 

3»13 Manipulation: involving analysis, synthesis, anticipation, 
retrospection, etc. leading to a holistic rather than 
fragmented or distorted determination of meaning 

3tl4 Variety and Flexibility: the use of a variety of strategies 
to determine meaning and flexibility in altering strategies 
to meet new needs 



3.15 Objectivity: extraneous personal, subjective, or emotional 
responses not allowed to interfere with the detenniaation of 
■eaning 

Verbal definitions of conprehension . Verbal definitions of reading 
comprehension were of two general types, skills-based definitions and cognitive- 
based definitions. Skills-based definitions presented concepts of comprehension 
in *..rms of the spacific skills which are deemed necessary in order for a 
reader to comprehend. In most cases, these skills were presented within 
hierarchical ornanizations (Andresen and Robinson, 1966; Cutter, 196?; Dale, 1965; 
V as, 19671 Joll, 196?; Letton, 1958; Piekarz, 1964; Smith, I960, Smith, 1969). 
However, some authorities have questioned the legitimacy of these hierarchical 
organizations, oaintaining that it is the nature of the material read 
coupled with the reader's purpose that determine the skills used (Bliesmer, 
1969; Heilman, 1969l Howards, 1965; KcCullough 1969| Sochor, 1959). Authorities 
also used skills-based definitions to describ . critical and creative reading 
when these two kinds of -higher- comprehension ability was discussed (Cooper, 
1964; Huus, 1965; Kay, 1946, Kassey, 1963; McCullough, 1954; Robinson, 1964; 
Williams, 1959). Skills-based definitions of comprehension were characterized by 
lack of clarity. When individual skills were described, imprecision often 
resulted, making the comparison of skills among different definitions extremely 
difficult. When, in aiiiticn to oompr9> ension, critical and creative reading 
were explained in terms of the skills supposedly involved, definitions became 
increasingly imprecise. A further difficulty with skills-based definitions arose 
from the conceptual boundaries within ^ ich these definitions were formulated. 
Little agreement existed among au.horities as to irtiether or not certain skills can 
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be legitimately subsumed under the heading -comprehension." 

While skills-based definitions described comprehension through the skills 
necessary to understand what is read, cognitfiv^^ased definitions provided explan- 
ations of comprehension in terms of the mentsl operations believed to produce this 
understanding (Carroll, 1964; Kingston, 19^8; Kress, I966, Wark, I968, Weaver, 
1964). Cognitiv^oased definitions varied in the manner by which they explained 
the cognitive operations producing comprehension. This variety in part resulted 
from the ftxndam^tal problem encountered in cognitiv^based definitions-li^e lack 
of a generally accepted explanation of cognition. Until an answer is provided 
to this basic question, the more particular question of the kinds of cognitive 
activity involved in reading conprehansio. nrust remain extremely tentative. 

The various verbal definitions of comprehension may be suinr-arized as follows: 
1.00 Skills-based definitions of comprehension 

1.10 Comprehension involves a number of separate skills which ^ire 

arranged hierarchically 
1.20 Comprehension involves a number of separate skills which are 

not arranged hierarchically 
1.30 Critical and creative resiling constitute high-level comprehension 
and involve separate skills which are distinguishable from those 
associated with lo*-level cbmprehensiou 
2,00 Cognitive-based definitions of cooprehension 

2.10 Comprehension is a cognitive process involving a variety of 
mental operations wh.ich may be described in various ways 

........... at com.r^ — - r--Hd^ bv .odels. Recently a number of models 

of comprehension have been proposed. These models have resulted at least in part 
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from the recognized need for greater precision and cooriination in data 
collection and theoretical speculation directed toirard understanding 
comprehension* However, when comprehension models were examined, confusion was 
* apparent since attempts to explain comprehension were made from different points 
of viewi the skills deemed necessary for comprehension (Gray, 1960; Rofcinson, 
19661 Spacha, I963), the instructional objectives considered necessary to 
teach comprehension (Barrett, 1970), the external influences f4iich may affect 
comprehension CKingston, 1961), the cognitive operations which aro conceived 
to produce conprehension (Cleland, 1966j Koines, 1962; KcCulloue?., 1968? Rystrom, 
I97O} anith, I960; Stauffer, 1969), and the psycholinguistic activity that seems 
to be involved in comprehension (Goodman, 1970} Ruddell, 1969 J Venezky and 
and Calfee, 1970) • An additional sotirce of confusion derived from the lack of 
generally accepted conceptual boundari.^^ wi*.hin iftiic!i conpirehensicn shcull ba 
considered. Although models have not produced the dafiiiitive explanation of 
reading compr'jhansion, they have illustrated with greater precision the 
intricacies aid problems involved in determining such an explanation* 

Definitions of reading comprehension provided by models may be summarized 
as follows, thou^ the several models differed considerably in details 

ItOO Comprehension involves a number of separate overt skills which 
reflet a coherent psychological whole 

2 #00 Comprehension Is describable in terms of a hierarchical organization 
of educational outcomes 

JtOO Comprehension is influenced by a number of external factors which 
affect its attainment 

4,00 Comprehension is a cognitive proces • comprised of a series of mental 
operations which may be described in various ways 
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5.00 Cooprehension is a bi^^ly complex cognitive process involving the 
• psyc'iological proces'^ing of language 

Concepts of Coaprehensicn Represented in Secondar y Professional Textbooks t 
Instruoticnal Laterirls. ani Tssxs 

Concepts of comprehension represented in sec ondary professional texttooks. 
Esoh textbook reviewed provided a verbal definition of coniprehension which, with 
only one exception, was expressed in terns of a hierarchical orgarxizr-tion of skills. 
Thus, the concepts of comprehension represented in these textbooks may be generally 
accounted for as verbally defined skills-based hierarchies. 

Concents of comprehension represented in seco ndary instructional materials. 
The instructional materials examined were placed into five categories (Basal 
Materials, Skills-Building Katerials, Materials for Special Gro'jps, ;»orkbooks, 
and Boxed Katerials) and the concepts of comprehension represented in the 
■ateriftls were determined within each of these categories. The prevailing 
concept of cor-prahension was represented verbally in skills-based non-hierarchical 
definitions. These definitions were found to predominate in four of the five 
categories of materials. In the fifth category, Katerials for Special Groups, 
either extremely vague or no definitions of comprehension were found. Tae second 
most prevalent concept of cor^pr-Jhension revealed in these materials was stated 
by verbal skills-based hierarchical definitions. 

Concepts of comprehension ret^resented in secondary tests. Some published 
reading tests were grossly deficient in their failure to state the concepts of 
comprehension upon which they were presumably based. Other tests provided only 
vague and insufficient descriptions of the concepts of comprehension which they 
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ostensibly measured. Where explicit definitions were given, they were expressed 
verbally and were based on the skills involved in comprehension. These skills were 
without exception conceived as operating in a non-hierarchical manner. Whether 
the testa reviewed actually did reflect the concept of comprehension (if any) 
on fdiich they were ba^ed was not pursued. 

Assessment of concepts of comprehension represented in secondary professional 
textbooks # instructional materials « and tests . Concepts of ccm prehension were 
represented in seconiary reeding professional textbooks, instructional 
materials, and published tests by verbal skills-based definitions. Textbooks 
generally aridngedcrmprehension skills hierarchically, ^ile materials and tests 
organizedcocprehension skills non-hierarchically. The difficulties generally 
associated with verbal definitions of comprehension were a.:>parent in the great 
majority of the verbal definitions in textbooks, neterials, and tests. The 
imprecision which characterized these verbal definitions l^d to confusion when 
individual skills were examined both within and across different textbooks, 
materials, and tes^.s. There also appeared to be little agreement concerning the 
conceptual boundaries within which coi^rehension should b'2 considered and tlie 
individual skills to be included within comprehension. 

CONCLUSIONS 

A basic dichotomy is revealed by this study between concepts of 
comprehension described in terms of overt behavior and those described in terms 
ofoovert b:shavior. Overt behavior associated with comprehension is usually 
described in terms of the particular skills which a refider must presumably 
exercise in order to comprehend. Covert behavior is described in terms of the 
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cognitive operations suppor>edly involved in oompreJiension* lluch of the 
difficulty in understanding the nature of comprehension appears to derive 
from a failure among experimenters and theorists to associate ovart behavior 
with underlying covert process t .aid seem fruitful to consider 
comprehension as a psychological process in terns of postulated covert behavior. . 
The overt behavior associated with comprehension nay then be considered as an 
outer manifestaticn of this postulated covert behavior. It may be argued that 
it is the psychology of comprehension which determines the outer display of 
understanding exhibited by readers when they perform comprehension skills. 
Until the covert psycholooical process which produces cc-Tprahe.uion is explain il, 
verbal descriptions of comprehension skills are almost certainly going to be 
imprecise since their psychological basis is not understood. Moreover, the 
conceptual boundaries within which comprehension is explained verbally are 
bound to remain unclear while the psychological process which determines these 
boundaries remains unexplained. 

The imprecision characteristic of the verbal skills-based definitions of 
comprehension represented in secondary reading professional textbooks, 
materials, and tests ap^rears to derive from a lack of a clear understanding of 
the psychological processes which constituta conprehansion# In no instance did 
textbook authors, materials builders, or test constmictors provide a T^ell- 
formulated psychological rationale for the verbal definitions of corprehension 
which they proposed. These definitions were almost always given solely in terms 
of the specific overt b^Jhaviors which readers are to display as evidence of their 
understanding* In the few instances when cognitive-based definitions were provided, 
they were given in an extremely vague fashion, and the relationship between these 
definitions and the overt behaviors expected of students was not made clear. 
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The lack of precision in descriptions of the concepts of comprehensioa 
underlying secondary reading professional tex^>books, instructional materials, 
and tests makes the development of effective reading programs in the 
secondary grades extremely difficult, if the definitions of comprehensioa 
which underly the instructional objectives set for teachers in professional 
textbooks, the materials available for teachers to carry out these objectives, 
and the tests used to measure the achievement of these objectiv-3s are not 
accurately understood, clearly articulated instructional programs are not 
possible. Unfortunately, it would seen that this condition existed at the 
time of this study. 
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